| 1. Identity statement | |
| Reference Type | Conference Paper (Conference Proceedings) |
| Site | mtc-m16d.sid.inpe.br |
| Holder Code | isadg {BR SPINPE} ibi 8JMKD3MGPCW/3DT298S |
| Identifier | 8JMKD3MGP7W/3836MPL |
| Repository | sid.inpe.br/mtc-m19@80/2010/08.09.17.09 |
| Last Update | 2010:08.18.19.38.57 (UTC) administrator |
| Metadata Repository | sid.inpe.br/mtc-m19@80/2010/08.09.17.09.17 |
| Metadata Last Update | 2021:01.02.22.18.49 (UTC) administrator |
| Secondary Key | INPE--PRE/ |
| Citation Key | AlmeidaPeFeMeGlFeNa:2010:Re14Ye |
| Title | Reprocessing of 14 years of GTS data at CPTEC/INPE for distribution  |
| Year | 2010 |
| Access Date | 2024, May 15 |
| Secondary Type | PRE CI |
| Number of Files | 2 |
| Size | 1358 KiB |
| 2. Context | |
| Author | 1 Almeida, Waldenio Gambi de 2 Pessoa, Alex Sandro Aguiar 3 Ferreira, Ana Lúcia Travezani 4 Mendes, Marcus Vinicius salgado 5 Gloria, Raphael Felca 6 Ferreira, Sérgio Henrique Soares 7 Nascimento, Jorge Weber Santana |
| Resume Identifier | 1 8JMKD3MGP5W/3C9JJBR 2 3 4 5 6 8JMKD3MGP5W/3C9JJ84 |
| Group | 1 DOP-CPT-INPE-MCT-BR 2 3 DOP-CPT-INPE-MCT-BR 4 DOP-CPT-INPE-MCT-BR 5 DOP-CPT-INPE-MCT-BR 6 DMD-CPT-INPE-MCT-BR 7 DAS-CEA-INPE-MCT-BR |
| Affiliation | 1 Instituto Nacional de Pesquisas Espaciais (INPE) 2 3 Instituto Nacional de Pesquisas Espaciais (INPE) 4 Instituto Nacional de Pesquisas Espaciais (INPE) 5 Instituto Nacional de Pesquisas Espaciais (INPE) 6 Instituto Nacional de Pesquisas Espaciais (INPE) 7 Instituto Nacional de Pesquisas Espaciais (INPE) |
| Author e-Mail Address | 1 waldenio.almeida@cptec.inpe.br 2 alex.pessoa@cptec.inpe.br 3 ana.travezani@cptec.inpe.br 4 marcus.mendes@cptec.inpe.br 5 raphael.felca@cptec.inpe.br 6 sergio.ferreira@cptec.inpe.br 7 weber@das.inpe.br |
| Conference Name | Conference on Interactive Information and Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, 26th. |
| Conference Location | Atlanta, GA |
| Date | 17-21 jan 2010 |
| Publisher | AMS |
| Book Title | Proceedings |
| Tertiary Type | Exhibition |
| History (UTC) | 2010-08-18 19:38:57 :: estagiario -> administrator :: 2010 2021-01-02 22:18:49 :: administrator -> marciana :: 2010 |
| 3. Content and structure | |
| Is the master or a copy? | is the master |
| Content Stage | completed |
| Transferable | 1 |
| Keywords | numerical weather forecast models weather forecasters |
| Abstract | The CPTEC is the Center for Weather Forecast and Climatic Analysis, a division of the INPE, the Brazilian National Institute for Space Research. The institution is a reference for space science, satellite imagery, and environmental studies in South America. Currently the politics of free data and software is being strengthened, as the INPExs administration has stated it as a priority for the following years. The institution is the largest distributor of satellite imagery and numerical model outputs in South America. The value of this reprocessing work on the archived conventional meteorological data is to provide a better database of observational data for distribution. Since the middle of 1995, when the data-processing system of the CPTEC started in an operational way, meteorological data from the GTS, the Global Telecommunications System sponsored by the World Meteorological Organization, began to be received and archived in tapes. These data are mainly the surface and upper-air conventional observations from all the globe, compound by synoptic stations, airports, ships, aircrafts and radiosonde data. The purpose of the operational work is to feed the numerical weather forecast models, the weather forecasters and the researchers, among other uses that had multiplied with the years. In order to be useful for the users, these data needs to be processed and decoded. The core of the data-processing system from CPTEC/INPE assembled in the first years were a set of FORTRAN programs from the ECMWF pre-processing system that have been modified for local needs. The processed data were converted to WMO's BUFR format and stored in an Oracle database. Starting at 2003 some efforts were applied to improve the data-processing system. The adopted strategy was to add a second processing suite using decoders from the UNIDATA's GEMPAK package. With this was possible to do comparisons and verifications, and this contributed for improved results. Other initiatives were on the data transmission, that was improved replacing a set of scripts by tools from the UNIDATA/UCAR and from the German Meteorological Service (DWD): The LDM, Local Data Manager; and the AFD (Automatic File Distributor). With the use of LDM the data from the UNIDATA's IDD (Internet Data Distribution) could be received to complement the data received from the Brazilian GTS's Regional Transmission Headquarters (RTH) at the National Institute for Meteorology (INMET). The reprocessing of our archived data was able to generate a increased number of observations. This is because during the operational processing always there are errors and data-loss that not always can be recovered at the time, and due to several other factors that can be better controlled during a late reprocessing than during the operational daily routine. However, the main reasons for the improvement of the results that we met should be credited to the availability of better decoders and more complete and accurate station tables. With better decoders and station tables, still was lacking one piece to do the reprocessing work in a more effectively way: a database for the raw GTS data. This issue was addressed in the last two years, when our data-processing system was improved again with the installation of new machines and the addition of a locally-developed database that was designed for the archiving of GTS data. Although this database still be in an experimental form, it made the reprocessing work easier and more controlled. A final step was realized with another database to organize the station tables, improving and completing it. For the reprocessing work we first recovered all the archived tapes and inserted the data on the database for the raw GTS data. With this step we not only eliminated duplications and wrong bulletins, as we could also control in a very effective way the completeness of our archive identifying periods with lost data or tapes. The second step was the extraction of the data in a form ready to feed the decoders, organizing them by the observation times. These data were processed using a set of modified GEMPAK's decoders to meet local necessities, and the results were made available to the users in GEMPAK format. |
| Area | MET |
| Arrangement 1 | urlib.net > BDMCI > Fonds > Produção anterior à 2021 > DIDAS > Reprocessing of 14... |
| Arrangement 2 | urlib.net > BDMCI > Fonds > Produção anterior à 2021 > DIDMD > Reprocessing of 14... |
| Arrangement 3 | urlib.net > BDMCI > Fonds > Produção anterior à 2021 > DIDOP > Reprocessing of 14... |
| doc Directory Content | access |
| source Directory Content | there are no files |
| agreement Directory Content | there are no files |
| 4. Conditions of access and use | |
| data URL | http://urlib.net/ibi/8JMKD3MGP7W/3836MPL |
| zipped data URL | http://urlib.net/zip/8JMKD3MGP7W/3836MPL |
| Language | en |
| Target File | Waldenio_Reprocessing.pdf |
| User Group | administrator estagiario marciana |
| Reader Group | administrator marciana |
| Visibility | shown |
| Read Permission | allow from all |
| Update Permission | not transferred |
| 5. Allied materials | |
| Mirror Repository | sid.inpe.br/mtc-m19@80/2009/08.21.17.02.53 |
| Next Higher Units | 8JMKD3MGPCW/3ETR8EH 8JMKD3MGPCW/43SKC35 8JMKD3MGPCW/43SQKNE |
| Citing Item List | sid.inpe.br/mtc-m21/2012/07.13.15.00.02 2 sid.inpe.br/mtc-m21/2012/07.13.15.01.44 1 |
| Host Collection | sid.inpe.br/mtc-m19@80/2009/08.21.17.02 |
| 6. Notes | |
| Empty Fields | archivingpolicy archivist callnumber contenttype copyholder copyright creatorhistory descriptionlevel dissemination doi e-mailaddress edition editor format isbn issn label lineage mark nextedition notes numberofvolumes orcid organization pages parameterlist parentrepositories previousedition previouslowerunit progress project publisheraddress rightsholder schedulinginformation secondarydate secondarymark serieseditor session shorttitle sponsor subject tertiarymark type url versiontype volume |
| 7. Description control | |
| e-Mail (login) | marciana |
| update | |